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1 Introduction 


A wide class of problems reduces to the problem of finding a zero point of the sum of a maximally 
monotone operator A and a cocoercive operator B acting on a real Hilbert space T-L. Problems of 
the above form arise in diverse areas of applied mathematics, including partial differential equations 
[46j . mechanics and evolution inclusions I2l|25l|26l|28l|29], signal and image processing and inverse 
problems [T6l |T8], convex optimization, statistics and learning theory [20l |2T1 |3ll HU [50], game 
theory [7| , variational inequalities [23l HT] HHl [53] , and stochastic optimization [SS] [U [5] . One of 
the most popular approaches to approximate a solution is the forward-backward splitting method 

[I2l[l6l[28]. 

The extension to the case of variable metric and to preconditioning has been considered in [ini[ii]- 
This extension is crucial, since preconditioned forward-backward splitting can be used to solve a 
broad class of structured composite monotone inclusion problems in duality, by formulating them 
as instances of the above fundamental monotone inclusion in product Hilbert spaces. Indeed, 
within this framework it is possible to recover several primal-dual splitting methods proposed in 
the literature, see [HEKH] for details. This basic procedure has been extended by using the 
product space reformulation technique to solve coupled systems of monotone inclusions in [2] and 
then in |52j . 

Inspired by the accelerated gradient method of Nesterov |3l], inertial variants of forward-backward 
splitting for solving monotone inclusions have been introduced in [38] (see also (STJ [T[ [32] ES] ). In 
particular, |38j discusses the derivation of inertial primal-dual algorithms from the inertial forward- 
backward algorithm applied to suitable monotone inclusions in duality. 

The goal of the paper is to extend this analysis to the stochastic setting. Recently, stochastic 
versions of splitting methods for monotone inclusions, such as stochastic forward-backward splitting 
Hass], stochastic Douglas-Rachford |15| . and stochastic versions of primal-dual methods as in 
0 [13 ES] have been proposed. These works have found applications to stochastic optimization 
[lass] and machine learning [211144| . In this paper, we propose and study a stochastic inertial 
forward-backward splitting algorithm for solving the following monotone inclusion. 

Problem 1.1 Let /? G ]0,-t-oo[, let he a real Hilbert space. Let U G 13(^) be self-adjoint and 
strongly positive, let A: "R — )• 2^ be maximally monotone, let B: T-L ^ Ti he such that for every 
{x,y) G 


{x — y \ Bx — By) > f3 {Bx — By \ U{Bx — By)) . (1.1) 

Suppose that the set V of all points x gB such that 

OgAx + Bx (1.2) 

is non-empty. The problem is to find a point in V. 

We show that the above inclusion includes as special cases coupled systems of monotone inclu¬ 
sions, arising in the study of evolution inclusions, variational problems, best approximation, and 
network flows. We refer the reader to [2] for a discussion of several applications. Our main result 
establishes almost sure convergence of the iterates of the considered algorithm. Such a result builds 
on ideas introduced in |T1] and [13] • As a corollary it allows to derive, as special cases, two new 
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classes of stochastic inertial primal-dual splitting methods for solving coupled system of composite 
monotone inclusions involving parallel sums. 

The rest of the paper is organized as follows. We recall some notation and background on 
monotone operator theory in Section [21 Then, in Section |21 we define the stochastic inertial 
forward-backward splitting algorithm solving Problem 11.11 and analyze its convergence. In Section 
m the application to coupled systems of monotone inclusions in duality, and minimization problems 
is derived. Finally, the derivation of two classes of stochastic inertial primal-dual splitting methods 
is proposed in Section [3l 


2 Notation—background and preliminary results 


Throughout, is a real separable Hilbert space. We denote by (• | •) and || • || the scalar product and 
the associated norm of %. The symbols ^ and —>■ denote weak and strong convergence, respectively. 
We denote by ^+(N) the set of summable sequences in [0,-|-oo[, and by the space of linear 

operators from % into itself. Let U G 23(^) be self-adjoint and strongly positive, i.e. 

(3x G ]0,-Foo[)(Vx G 7^) {Ux\x)>x\\xf- (2.1) 

We define a scalar product and a norm respectively by 

(Vx G T-L)(yy & %) (x I y)jj = {Ux \ y) and ||x ||;7 = ^J{Ux\ x). 

Let H— 7 > 2^ be a set-valued operator. The domain and the graph of A are defined by 

domH = {x G ^ I Ax 7 ^ 0} and graH = {(x,rt) G ^ x ^ | tt G Ax], 

The set of zeros of A is zer H=|xG'H|OG Hx} and the range of A is ran A = A{'H). The inverse 
of Als A-^:n^2^: tt !-)• {x G ^ I M G Hx}. The resolvent of A is 

JA = {ld+A)-\ (2.2) 

where Id denotes the identity operator of T-L. Moreover, A is monotone if 

(V(x, u) G graA){y{y, v) G graH) (x — y | n — x) > 0, 

and maximally so, if there exists no monotone operator A: T-L ^ T-L such that gra A C gra A 7 ^ gra A. 
Let T: Ti ^ Ti. Then T is firmly nonexpansive if 

(V(x,y)GiH2) ||rx-Ty||2< ||x-y||2-||(Id-r)x-(Id-r)y||2. (2.3) 

If A is monotone, then Ja is single-valued and firmly nonexpansive, and, in addition, if A is 
maximally monotone, then dom Ja = T-L. The parallel sum of ^ 2^ and B: TL ^ 2^ is 

AaB = (A-^ + B-^)-^. 

A is demiregular at y G domH if, for every sequence {yn,Vn)nen in graH and every v G Ay, we 
have (yn ^y, Vn^ v) => y„ y. 
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Let ro(^) be the class of proper lower semicontinuous convex functions from to ]—oo, +oo]. 
For any self-adjoint strongly positive operator U G and / G we define 

prox^ : T-L ^T-L: X ^ argmin (f{y) + -||a; — y\\u), (2.4) 

y&H 2 

and ^ 

proxf : Ti ^ T-L : X argmin (f{y) H — ||a^ — y|P) • 

y^n 2 

It holds proxj = Jjj-igf, and proxj = Jdf coincides with the classical definition of proximity 
operator in [^. The conjugate function of / is 

f*: a ^ sup {{a \ x) - f{x)). 

x^T-L 


Note that, 

(V/ G ro(^))(Vx G ^)(Vy G y £ df{x) 4^ x £ df*{y), 

or equivalently, 

(V/ G ro(1I^)) (df)-^ = df*. (2.5) 

The infimal convolution of the two functions / and g from T-L to ]—oo, -|-oo] is 


f ag: x^ inf {f{y)+g{x - y)). 
y£H 

The strong relative interior of a subset C of ^ is the set of points x £ C such that the cone 
generated by — x -|- C is a closed vector subspace of %. We refer to [3] for an account of the main 
results of convex analysis, monotone operator theory, and the theory of nonexpansive operators in 
the context of Hilbert spaces. 

Let (H, T, P) be a probability space. A ^-valued random variable is a measurable function 
X: Q ^ T-L, where Ti is endowed with the Borel cr-algebra. We denote by cr{X) the ci-field generated 
by X. The expectation of a random variable X is denoted by E[A]. The conditional expectation of 
X given a ci-field A C T is denoted by E[A|A]. Given a random variable Y: H —)• "H, the conditional 
expectation of X given Y, that is E[A|cr(T)] is denoted by E[A|y]. See [27] for more details on 
probability theory in Hilbert spaces. A 7^-valued random process is a sequence (x,i)„gj^ of 7^-valued 
random variables. The abbreviation a.s. stands for “almost surely”. 


Lemma 2.1 [35l Theorem 1] Let {3'n)neN be an increasing sequence of sub-a-algebras of T, let 
{zn)n£N, {f,n)neN, (Cn)nGN o,nd {tn)n£N be [0,+oo[-valued random sequences such that, for every 
n G N, Zn, fn, Cn, CLud tn are Un-nreasurable. Assume moreover that < +oo, Cn < 

-|-oo a.s., and 

(Vn G N) E[Zn+l\3'n] < +tn)Zn +(n - a.S.. (2.6) 

Then {zn)n£N converges a.s. and (^n)nGN is summable a.s.. 


The following lemma is a special case of m Proposition 2.3]. 
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Lemma 2.2 Let C be a non-empty closed subset of Li and let {xn)neN be a LL-valued random 
process. For every n E N, set Ln = cr{xo,... ,Xn). Suppose that, for every x G C, there exist 
[0, +oo[-valued random sequences {f,n{x))neN, {Cn{x))n£N and {tn(x))n£N such that, for every n E N, 
(,n{x), Cn(x) and tn{x) are Ln-measurable, (Cn(a^))neN and {tn{x))n£n are summable a.s., and 

(Vn E N) E[||a:n+i - xiPiS'n] < (1 + t„(x))||xn - x||^ + Cn(a:) - ^n(a;) a.s. (2.7) 

Then the following hold. 

(i) ixn)n£N is bounded a.s. 

(ii) There exists Ll <G Ft. such that P(f2) = 1 and, for every oj G Ft and x G C, (||x,i(a;) — 
converges a.s. 

(iii) Suppose that the set of weak cluster points of {xn)n£N is a subset of C a.s. Then {xn)n£N 
converges weakly a.s. to a C-valued random vector. 

Lemma 2.3 [HI Lemma 3.7] Let A: LL ^ 2^ be maximally monotone, let U G T>{fH) be self- 
adjoint and strongly positive, and let Q be the real Hilbert space obtained by endowing LI with the 
scalar product {x,y) {x \ y)u-i = {x \ U~^y). Then, the following hold. 

(i) UA-.g ^2^ is maximally monotone. 

(ii) JjjA: g ^ g is firmly nonexpansive. 


3 Main results 


In this section we introduce the stochastic inertial forward-backward algorithm for solving Problem 
II. H and analyze its convergence behavior. We recall that jd is the constant defined in (I3.23p . 


Algorithm 3.1 Let e G ]0, min{l,/3}[, let (7n)ngN be a sequence in [e, (2 —e)/3], let (An)nGN be 
a sequence in [e, 1], and let (ari,)neN be a sequence in [0,1 —ej. Let {rn)n£¥i be a "H-valued, 
square integrable random process, let xq be a 7^-valued, squared integrable random variable and 
set X-i = Xq. Furthermore, set 


(Vn E N) 


'^n — Xn CyjiiXri X 
LnU'f'n 

Pn — J'ynU Ai^n) 

Xn+1 — Xji -|- XniPn 


Theorem 3.2 Consider Algorithm \‘3.1\. and set (Vn E N) Tn 
following conditions are satisfied. 


n—l) 


Xn)- 

= fj(xo, . . .,Xn). 


(3.1) 


Suppose that the 


(i) (Vn E N) E[rn\Tn] = Bwn a.s. 

(ii) EnGN “ BWn\\‘^\Tn] < +00 O.S. 
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(iii) sup„gi^ \\xn - x„_i|p < oo a.s. and < +oo a.s. 

Then, the following hold for some a.s. V-valued random variable x. 

(i) Xn ^x a.s. 

(ii) Bxn Bx a.s. 

(iii) If B is demiregular at x, then Xn ^x a.s. 


Proof. Let x and set 

(Vn € N) Un = Wn-Pn-'lnU{rn-Bx). 


Since 


(Vn G N) Xji+l — (1 ^n)Xn -\- I^nPni 

then, upon setting V = U~^, and using the convexity of || • \\y, we obtain 

(Vn G N) ||Xn+l - x\\y < (1 - An)||Xn - x\\y + \n\\Pn “ x\\y. 


Since x G P, we have 

(Vn G N) X = J-.,^ua{x - ^nUBx). 

By Lemma l2.3l f hi. J-y^uA is firmly nonexpansive with respective to || • ||y, and therefore 

(Vn G N) \\pn - x\\y < \\Wn - X- '^nU{rn - Bx)\\y - llttnlly 
= \\Wn - x\\y - 2'yn {Wn - X | - Bx) 

+ Jn\\U{rn - Bx)\\l - \\Un\\v- 


Using (i), since Wn is 3'n-nieasurable, we have 


(Vn G N) E[(u;n - x | - Bx) |Jn] = {wn - x \ E[r„|J„] - Bx) 

= {Wn — X I BWn — Bx) . 


By the same reason, for every n G N, Bwn is ILn-measurable, and we also have 

E[\\U{rn - Bx)||^|3-„] = E[\\U{rn - BWn)fv\3^n] + \\U{BWn - Bx)fy 

+ 2E[(B'U;n - Bx\rn- BWn) jS'n] 

= E[\\U{rn - BWn)fv\Tn] + \\U{BWn - Bx)fy 
+ 2 {Bwn - Bx I E[r„| - Bwn) 

= E[\\U{rn - Bwn)fv\Tn] + \\U{Bwn - Bx)fy 
< E[\\U{rn - BWn)\\v\3'n] +/3“^ {Wn-x\ BWn “ Bx) , 


(3.2) 

(3.3) 

(3.4) 

(3.5) 

(3.6) 

(3.7) 


(3.8) 
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where the last inequality follows from (|c{.29p . Therefore, for every n € N, we derive from (|3.6I) . (j3.7|) . 
and (|3.8p that 


E[||Pn - ^^llyld'n] < \\u)n “ x\\y - 7^(2 - /3 ^n) {Wn - X \ BWn “ Bx) 
+ 7nE[||17(r„ - Bwn)fv\9^n] - E[||17„||^|T„] 

< \\Wn - x\\y - E'Jn {Wn - X \ BWn - Bx) 

+ 7nE[||C/K - BWn)fv\‘3^n] " E[|| [/„ || ^ | T„] 

^ \\Xn x\\y + ^llv^ H^^n—1 ^lly) T Cn 


where 


(Vn G N) 


Cn — 2 Q;, 2 ||Xfi_i XnIIy T 7nE[|| t^(^n ||y |S^n] 

^Cn = E[||17n||y|Tn] + {Wn - X \ BWn “ Bx) . 

Using (|3.4D and (|3.9p . we obtain, 

(Vn G N) E[||x„+1 - x||y| Jn] < (1 - An)||Xn - x||y + AnE[||p„ - xllylTn] 

^ (1 T Q;fi)||x^ ^lly T Cn (oinll^n— 1 x\\y T Cn)- 


(3.9) 

(3.10) 


(3.11) 


By (I3.10p and since B is monotone, for each n G N, Cn and Cn are non-negative and T^-measurable. 
By (bl) and (cl), (Cn)neN is summable, and hence, we derive from Lemma ITT] that 


3 T = lim ||Xn — x||y 


and E (OfillXfi—l 3;||y -|- Cn) ^ “bOO. 

nGN 


Moreover, since inf^gpj 7 n > e > 0, we also have 

{Wn — X I BWn — Bx) < -|-00 {Wn — X \ BWn — Bx) —>• 0. 


neN 


and 


^ E[\\Unf\3^n] < +00 ^ E[||n;„ - Pn - 7nU{rn - Bx)f\7n] ^ 0. 
neN 

Next, using p3.29p . we derive from p3.13p that 


(3.12) 

(3.13) 

(3.14) 


BWr, —)• Bx. 


(3.15) 


We also derive from (|3.14p . (bl), and (|3.15l) that 

E[||u;„ - PnflS^n] < 2E[||n;„ - 7„C/(r„ - Bx)f\3^n] + 2E[||7„U(r„ - Bx)f\3^n] 

< 2(E[\\wn-Pn - lnU{rn - 5x)f |T„]) + 4E[||7„[/(r„ - BWn)f\3^n] 



-b 4:\\-fnU{BWn - Bx)\f 0. 

(3.16) 

Hence, since 

inf„gi^ 7 „ > 0, we obtain 



E[||r„-Hxf|J„] ^0. 

(3.17) 

Now define 

(Vn G N) Pj^ = J.y^A{Wn - 'ynUBWn). 

(3.18) 
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Then is 3"n-measurable since ° (Jd.—'JnUB) is continuous. Therefore, by (I3.16|l and (bl) 
(Vn G N) \\Wn -PnWv = E[|kn -PnWvl^n] 


^ 2E[||pn ~ 'Ji'nily l-bn.] + “^^[WlnU{f'n — StCn) ||y |Tn] —>■ 0. 


(3.19) 


(i) Let uj ^ Q., and let z G P be a weak cluster point of (xn(a;))ngN- Then, there exists 


a subsequence (xfe^(a;))neN which converges weakly to z. It follows from our assumption that 
{wk„{uj))n&^ converges weakly to 2 . By ()3.19p . converges weakly to z. On the other 

hand, since B is maximally monotone and its graph is therefore sequentially closed in X ^strong 

[3l Proposition 20.33(ii)], by (|3.15l) . Bx = Bl. (|3.32l) . we have 


U (wkM-PkA^)) 

Ikn 


- BwkM e Apk„{u), 


(3.20) 


and hence using the sequential closedness of graA in ^weak x ^strong Proposition 20.33(ii)], 
we get —Bl G Az or equivalently, T G zer(74 + B) = V. Therefore, for every w G fl, every weak 
cluster point of (xn(a;))„,GN is in V which is a non-empty closed convex [3l Proposition 23.39]. 


Recalling ()3.1ip and applying Lemma [22 Kiii), we derive that (xn)neN converges weakly to a V- 
valued random variable x. 


(ii) Since U is strongly positive, there exists a positive constant y such that (Vy G 
Therefore, we derive from (13.291) that 


-H) {y I Uy) > 


(Vz G n)iyy G n) \\Bz - By\\ < iPxr^Wz - y\\, 


(3.21) 


which implies that 

(Vn G N) \\BXn - BWnW < (/^x)“^lkn - WnW 

= {l3x)~^an\\xn-Xn-i\\^^ by (cl). 


(3.22) 


Now, using (13.150 . we obtain Bxr, 


Bx. 


(iii) This conclusion follows from the definition of demiregular operator and (ii) □ 


Corollary 3.3 Let K be a strictly positive integer, let j3 G ]0, +oo[, let Lii,... ,'Hk real Hilbert 
spaces. For every z G {1,..., K}, let Ui G 'LiJ-ii) be self-adjoint and strongly positive, let Ai: Hi ^ 
2^* be maximally monotone, let Bi'. Hi x ... x Hk —t T~Li sueh that for every x = {xi)i<i<K and 
y = {yi)i<i<K in Hi X ... X Hk, 


K K 

^ {xi - yi I BiX - Biy) > /3 ^ {BiX - Biy \ Ui{BiX - Biy)). 
i=l i=l 

Suppose that the set V of all points x = {xi,... ,xk) in Hi x ... x Hr such that 

0 G -|- Bix 

0 G Arxk + Brx 


(3.23) 


(3.24) 























is non-empty. Lets € ]0, min{l,/3}[, let (7n)neN be a sequence in [e, (2 —e)/3], let (An)nGN be a 
sequence in [e, 1], and let be a sequence in [0,1 — e]. For every i E {1,... let 

he aFLi-valued, square integrable random process, let he aFLi-valued, squared integrable random 
variable and set Xi-i = Xi^. Furthermore, set 


(Vn E N) 


For i = 1,... ,K 

Wi^n — Xi^ji -|- Cin(Xi^n ^i,n—1 

^i,n — ^nUiri^n 

Pi,n = J-ynUiAii^i^n) 

Xi,n+l — 3^1,n “1“ ^n{Pi,n Xi^n) 


(3.25) 


Then Problem \3.24\ and Algorithmic^ are special cases of Problem, \1.^ and Algorithmic^^ respec¬ 
tively. 


Proof. Let Ti be the Hilbert direct sum TLi © ... © LLk with the scalar product and the norm 
defined respectively by 


K 

{{■ \ ■)): {x,y) h^'^{xi\ yi) and ||| • ||p : a; ((® | a;)), (3.26) 

i=l 

where we denote by a; = {xi)i<i<K and y = {yi)i<i<K the generic elements in PL. Set 


A.. PL y . X I y ; 

< B: PL^ PL. X i-A [Bix)i<i<K, ( 3 . 27 ) 

_U: PL ^ PL: X {UiXi)i<i<K. 


Then V = zer(A + B), A is maximally monotone by [3l Proposition 20.23]. Since U is self-adjoint 
and strongly positive, UA is also maximally monotone by Lemma 12.31 and by O Proposition 
23.16], its resolvent is 

(Va; E PL) Jjjax = {JuiAiXi)i<i<K- (3.28) 

Moreover, in view of (|3.26ll . condition (I3.23p can be written as 

{{x - y \ Bx - By)) > f3\\\Bx - By\\\l;, (3.29) 


which shows that B is monotone and continuous, and hence maximally monotone [3l Corollary 
20.25]. We define 

■ ■ ■ 1 ^K,n)t 

Xn — ( 2 ^ 1 ,nj ■ ■ ■ ) Xx,n)i 

< Wn = ■ ■ ,WK,n), ( 3 . 30 ) 

Pn ~ (Pl,nj • • • jPK,n)j 

_ 'f'n — (^l,n) ■ ■ ■ 1 XK,n)i 


and we get 


(Vn E N) Cn = cr{xo,... ,Xn). 


(3.31) 


Moreover, in view of ()3.27p and ()3.30p . conditions (i) (ii), and (iii) can be rewritten as 
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(al) For every n € N, E = Bw^- 

(bl) EnGNTnE [llkn “ BWn\f |3'n] < +00. 

(cl) sup^gi^ 111®^ - »„_i||| < oo a.s. and EngN“»^ < +oO' 


Now, using (I3.28P and (|3.3UI) . we can rewrite the algorithm (|3.ip as 


(Vn G N) 


'^n — 3“ Q^n(®n ®n—l) 

Zn — 

Pn ~ J'Yn'UA{Zn) 

®n+l — 3“ ^n{Pn ®n)' 


□ 


(3.32) 


Remark 3.4 Here are some comments concerning the demiregularity notion and the cocoercivity 
of H. 


(i) Demiregularity is a general notion that captures several properties typically used to establish 
strong convergence of iterative algorithms. See [2] for a discussion and special cases. 

(ii) The condition (|3.23p is equivalent to the cocoercivity of ^/\JB^/\J which is weaker than the 
cocoercivity of B and this condition was first considered in m- 

(hi) If B is /3o-cocoercive, condition (|3.23p is satisfied with /3 = /3o/||U||. Indeed, we have 

(Vs € n) ((s I Us)) < ||U||||sf. (3.33) 

Therefore 

(VsG?^)(Vy G-R) {{x-y\Bx-By))>l3o\\\Bx-By\f>l3\\\Bx-By\\\l. (3.34) 

Remark 3.5 Here are some connections to existing work. 


(i) The system of inclusions [3)21] was first studied in [2], in the special case (Vi G {1,... , iV}) Ui = 
Id. Morever, in the same paper, in the deterministic setting, a forward-backward splitting 
method [161 [28] in a suitable product space was proposed for solving it. Furthermore, when 
in Problem 11.11 (Vn G N) = Bxn, the proposed algorithm reduces to the inertial forward- 
backward algorithm proposed in |38| and, in this case, the weak convergence was proved 

in Theorem 13.21 is replaced by the weaker condition that 


m 

(a 


where the condition (iii) 

Xn — a^n-i|P)neN Is summable. 


(ii) If (Vn G N) On = 0, the proposed method reduces to a stochastic forward-backward algorithm. 
In this case, almost sure convergence of the algorithm (|3.ip was proved in |43] under the 
additional assumption that Bi is uniformly monotone, and under some weaker conditions on 
the stochastic errors. 


(iii) If (Vn G N) = 0, almost sure convergence of the algorithm (|3.1I) for solving Problem 11.11 
was proved in m under the stronger condition that 

E[||r„ - Bxn\\\{xo, .. ■,Xn)] < + 00 . (3.35) 
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4 Applications to composite monotone inclusions involving paral¬ 
lel sum 


In this section, we focus on a structured system of monotone inclusions which covers a wide class of 
monotone inclusions involving cocoercive operators in the literature, see [iziiianiiseiiiolEaliH] 
and the references therein. The contribution of the section is twofold: on the one hand we will 
show that it is possible to prove convergence of many existing algorithms even in the presence of 
stochastic perturbations. On the other hand, we will derive two new classes of stochastic inertial 
primal-dual splitting methods based on different choices of the preconditioning operators. We 
remark that Algorithm (14.5111 is new even in the deterministic setting. 


Problem 4.1 Let m and s be strictly positive integers, let vq and /Uq be in ]0,-|-oo[. For every 
z E {1,... , m}, let (/Cj, (• I •)) be a real Hilbert space, let Zi E /Cj, let Ai\ ICi ^ 2^* be maximally 
monotone, let Vi E be self-adjoint and strongly positive, let : /Ci x ... x ICm —5- ICi be such 

that for every x = {xi)i<i<m and y = {yi)i<i<m in /Ci x ... x JCm, 

m m 

^ {Xi - Vi I CiX - Civ) > 1^0 X] “ Ciy\\\. ( 4 . 1 ) 

i=l i=l 

For every k E {1,... ,s}, let {Qk, {■ \ •)) be a real Hilbert space, let Bj. \ Qj. ^ 2®* be maximally 
monotone, let E Qk, let Wk E be self-adjoint and strongly positive, let Dk'- Qk 2^'= be 

maximally monotone and suppose that is single-valued and such that, for every Vk E Gk and 
Wk E Gk^ 

s s 

- Wk I D~^Vk - D~^Wk) > yo'^\\D~^Vk - D~^Wk\\w^. (4-2) 

k=l k=l 


For every i E {1,..., m} and every A: E {1,..., s}, let Lk^i: JCi ^ Gk be a bounded linear operator. 
Suppose that the set V of all point x = (xi,... ,Xm) in /Ci x ... x ICm such that 


zi 


k=l 


E AiXi -|- 'y ^ Ll.1 ( (Dk □ Bk) f Lk^iXi — Tkjj + Cix 


2 = 1 


(4.3) 


k=l 


E AmXm + L^^m f i^k D Bk) ( Lk^iXi — Tfc j j + C., 


2=1 


rX 


is non-empty. Denote by V the set of all solutions v = (vi,... ,Vs) E Gi x ... x Gs to the dual 
inclusion 


^^X — (^2)l<2<m ^ 


' s 

' m 

2:1 - ^ Ll iVk e Aixi + Cix 

Li^iXi - ri E Hf -h D^^vi 

k=l 

2=1 

< 1 and < 


s 

m 

^ ^ ^k,m^k ^ “1“ CmX^ 

^ ^ Tg ^ Bg Vg -|- Vg 

^ k=l 

K '^=1 


The problem is to find a point in P x P. 


(4.4) 
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Remark 4.2 As noted in [S2], in Probleni l4.ll the variables are coupled in two different ways. The 
hrst one is the smooth coupling induced by (Ci)i<j<m. The second one is the non-smooth coupling 
involved in the parallel sums in the second terms in (14.3|) . 

Note that, since we assume that V is nonempty, T> is nonempty as well. Let us introduce the 
Hilbert direct sums 

Xi =/Cl © ... ©/Cm, Q = Gi® ■ ■ ■ ® Gs, and 'H = K®G, (4.5) 

endowed with the scalar product and the norm defined as in (|3.26l) . With a slight abuse of notation, 
in all spaces, the scalar products and norms are denoted as (• | •) and || • ||, respectively. We denote 
hy X = {Xi)i<i<m, y = {yi)i<i<m the generic elements in K, and by u = {vk)i<k<s, w = {wk)i<k<s 
the generic elements in Q. The generic elements in 'H will be denoted by x and y. We also consider 
the linear operators 

T: K, ^ G - X ^ 1 Lk^iXij 

. (4.6) 

We first need the following lemma which follows from |36l Lemma 4.3(i) and Lemma 4.9(i)]. 

Lemma 4.3 In the setting of Problem \4-l\ let L, V, and W be defined as in (|4.6p . Suppose that 
WVwlWw < 1 and set 

{x,v)e^ {V-^x - L*v, W-^v - Lx) 

[T: {x,v) ^ {VxfiW-^ - LVL*)-^v). 

Then U' and T are self-adjoint and strongly positive, with 

{VxG'H) (U'x|x)>^(l-||VWL/^f)min{||V-^||,||LL-i}||x||2, (4.8) 

and 

(VxG-K) (Tx I x) > min{||F"^irX||W"^^-LFL*||-^}||xf. (4.9) 

In particular, U' is invertible, and its inverse U = (U')“^ is self-adjoint and strongly positive. 

Lemma 4.4 Consider the setting of Problem \f.l\ and define 

AT. H 2”^ . (aj, v) I ^ (( Zi + AjXj)i<j<mj iTk T '^k)i<k<s) 

) (4.10) 

Q {x,v) ^ {{Cix) {Dk ^Vk)i<k<s^ ■ 

Then the following hold. 

(i) Problem \4.1\ is a special case of Problem 11.il with TL = TL, A = M + S, B = Q and U G 

{U,T}. 

(ii) (0 / p) ^ (0 / zer(M + S + Q) CV xV). 
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Proof. We note that the operators V and W, defined in equation (14.61) . are self-adjoint and 
strongly positive on /C and G, respectively. Set 

A: /C —7- 2^ : £C I—^ X AjXj 
B: Q ^ 2^ : V 1-^ X 

C:K^K:x^{Cix) 

l<i<m 

D\ Q ^ 2^ \ V ^ {Di,Vk)i<k<s 

Z - (^1, . . . , ZjTi) 

r = (ri,.. .,rs). 


(4.11) 


Then, it follows from (|4.1I) that 

(Va; G 1C)(yy G /C) {x — y \ Cx — Cy) > vq\\Cx — CyW^, 
and from (j4.2l) that 

(yv G G){\/w G G) y — w \ D~^v — > yQ\\D~^v — 


w 


w 


(4.12) 


(4.13) 


In view of Remark I3.^1ii)[ y/VC^/V and y/WD ^y/W are, respectively, uq and fjQ cocoercive. 
Therefore, by [36l Lemma 4.3(ii)], we obtain, for every G ]0,+oo[, 

(Vx G ^)(Vy G ?^) (x - y I Qx - Qy) >/3^||Qx - Qyllu, (4.14) 

where is defined by 

y = il- \\VWLVvf)mm{iyo{l + C\\VWLVv\\)-\no{l+r^\\VWLVv\\)-y. (4.15) 

By |36l Lemma 4.9(ii)], we obtain 

(Vx G ^)(Vy G ?^) (x-y I Qx-Qy) >/3||Qx - QyllT, (4.16) 

where /3 is defined by 

(3 = mm{uo,yo{l-\\VWLVvf)}. (4.17) 

Since both U and T are strongly positive by Lemma 14.31 either (|4.14p or (|4.16ll implies the coco- 
ercivity of Q and hence Q is maximally monotone O Corollary 20.25]. Moreover, it follows from 
[31 Proposition 20.23] that A and B are maximally monotone. Let us define 


L*:G^K:v^(Y,LI 


iVk 


k=l 


l<i<m 


and consider the following inclusion in the space PL, 

y — L*v, Lx — r) G ^(A -|- C)x, {B~^ + D^^)v 

Note that we can rewrite M, S and Q as follows 

M: PL —2^ : (a;, v) {—z + Ax, r -|- B~^v) 
SiPL^PL: {x,v)^ {L*v, -Lx) 

Q-.Pi ^ Pi: {x,v) {Cx,D~^v). 


(4.18) 


(4.19) 
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Thus, M and S are maximally monotone. Moreover, M + S is maximally monotone since S is 
maximally monotone and single-valued [31 Corollary 24.4]. 



Note that V ^ 0 implies that 


zer(M' + S + Q) ^ 0. 


(4.20) 


Furthermore, the problem (|4.18l) reduces to find a random vector zer(iW + S + Q)-valued almost 
surely. Next, let {x,v) be a solution to (|4.18p . Then, by removing v from ()4.18p . we obtain 

ze{A + C)x + L*{BaD){Lx-r), (4.21) 

which implies that x ^V. By the same way, removing x from (14.181) . we obtain 

-re -L{A + C)-^{z - L*v) + (4.22) 

Therefore, there exists x such that 

X G (A + C)~^(z — L*v) and Lx — r G B~^v + D^^v, (4.23) 

which implies that v gT>. To sum up, zer(iW + S + Q) gV x V. □ 

Remark 4.5 Proceeding as in [361 Remark 4.4(i)], if we maximize /3^ with respect to we get 
that Q satisfies 


(Vx G ^)(Vy gB.) (x - y I Qx - Qy) > /3|||Qx - Qy||^ 

where 

\l (f^o - + AWVWLVVfvolio 

2iIoUWL7V\\ 


(4.24) 


(4.25) 


4.1 A first class of stochastic inertial primal-dual splitting methods 


Our first class of stochastic primal-dual splitting algorithm for solving Problem 14.11 which corre¬ 
sponds to the choice of 17 = U in Lemma 14.41 

Algorithm 4.6 Let ^ G ]0,-|-oo[ be defined by (|4.25l) . (5 = /3| be defined according to (I4.15p . let 


E G 


0,min{l,/l} 


let (An)ngN be a sequence in [e, 1], and let (an)neN b® a sequence in [0,1 — ej. 
For every i G {1,... ,m}, let (aj^n)nGN be a /Cj-valued, squared integrable random process, and let 
Xifi be a /Cj-valued, squared integrable random vector and set Xi-i = Xifl. For every A: G {1,..., s}, 
let (bj^n)neN be a ^j-valued, squared integrable random process, and Vi^ be a ^j-valued, squared 
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integrable random vector and set Vi^-i = Vi^. Then, iterate, for every n € N, 


[i) For i = 1,..., m 
I — Xi,n T ^i,n—l) 

{ii) For /c = 1,..., s 
I ^fc,n '^k,n T ^n{yk,n '^k,n—l) 


) 

For i = 

= 1,.. 

., m 

1. 

ti,n — 

ELi 

i^k,n ^i,n 

2. 

Pi,n ■ — 


(q,?! 

3. 

yi,n • = 


Q,n 

4. 

Xi^n+1 

:= Xi^ 

n H“ ^n{Pi,n ^ 2 ,n) 


(iv) For fc = 1,..., s 

f • '^k,n ^k,iyi,n ^k,n 

2’ (lk,n ■— {dk,n T ^^ki^Uk,n ^fc)) 

3’ • '^k,n T ^n{(lk,n '^k,n)- 

Theorem 4.7 Consider Algorithm ic and suppose that 

^> 1 / 2 . 


Set 


(Vn G N) 


•— {xi,m • • • ) Xm,ni ^l,n) • • • j Vs^n) 
• • • ) ^m,m • • • , 

^ 3 ~n — (^ 0 ! ■ ■ ■ ) ) 


and suppose that the following eonditions are satisfied: 


(4.26) 


(4.27) 


(4.28) 


(i) (Vn G N) E[an|3'— ((C*i(ci^n • • • ; am,n)}l<i<mj di^nj ■ ■ ■ 1 Dg dg^n) a.s. 

(ii) X^nGN ^[Xyj=l ■ ■ ■ Tm,n) IP + XyA:=l ^A:,n|P IS'n] < TCX) a.S. 

(hi) sup„gj^X^™i lki,n - a^i.n-ilP < OO a.s. and sup^gj^ X]fc=i - ffc.n-ilP < oo a.s., and 
X^neN < +00. 


Then the following hold for some random vector (xi, ..., Xm, vi,..., Vg), V x V-valued a.s. 


(i) (Vi G {1,..., m}) Xi^n Xi and {Mk G {1,..., s}) Vk,n ^ Vk a.s. 

(ii) Suppose that the operator (xi)i<j<m {Cj{xi)i<i<rn)i<j<m is demiregular at {xi,... ,Xm), 
then (Vi G {1,..., m}) Xi^n Xi a.s. 

(hi) Suppose that there exists j G {!,... ,m} such that DJ^ is demiregular at vj, then vj^n Vj 

a.s. 

(iv) Suppose that there exists j G {1,..., m} and an operator C: fCj ^ fCj sueh that (V(xi)i<i<m G 
Cj{xi,... ,Xm) = Cxj and C is demiregular at Xj, then xj^n Xj a.s. 
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Proof. We first observe that (|4.26p is equivalent to 


ii) 

For i = 1,... 

, m 




Q,n — ^i,n H“ 


- 1 ) 

{it 

) For A: = 1,. 

. ,s 




+ 

II 

s 

•4^ 

C^n{Xk,n 


a-l) 

{in) For i = 1,. 

.., m 




1- V-\ci,n - 

Pi,n) 

ELi 



2- Xi_^ri-\-l — 

,n T Xn 


^i,n) 

(iv) For k = 1,. 

. . ,S 




1 . W^\dk,n 

“ Qk,n) 

-ET= 

1 


(4.29) 


i,n Pi,in') ^i,n € C 

2 ’ '^k,n “b ^nisik,n '^k,n)- 


Upon setting 


(Vn G N) 


Un — (ci,n) • • • ) Cm,ni • • • ; Cg^n) 

Yn — {,Pl,ni ■ ■ • ) Pm,n: Ql,ni ■ ■ ■ j Qs,n)i 


we can rewrite (I4.3ip as the following 
(Vn G N) 


!• — Xfi + ^n—l) 

2 . U"^(u„ - y„) - a„ G My„ + Syn 

3. — Xfj + Xjiiyn ^n) 


1. U„ = X„ + an(Xn - X„_i) 

2. Yn = <Aj(M+S)(Un — Ua„) 

3. X^_|_i — X^ + Xnfyn XjT,), 


(4.30) 


(4.31) 


which is a special instance of the iteration (|3.ip with (Vn G N) 7 ^ = 1 G e, (2 — e)f3 
that our conditions can be rewritten in the space Pt as 

(al) (Vn G N) Efa^lJ^] = Qu„. 

(bl) EnGN^III^" - Qw|p| 3 'n] < +00. 

(cl) sup^gp^ ||x„ - x„_i|p < 00 a.s. and < +°°' 

Therefore, every specific conditions in Algorithm 13.11 and Theorem 13.21 are satisfied. 


. We next see 


(i) In view of Theorem I3.^1i)[ x„ ^ ix,v) which is equivalent to (Vi G {1,... ,nT,}) Xi^n Xi 

Vk- 


and (V/c G {1,... ,s}) Vk,r 


(ii) V: (hi) By Theorem I3.1^fii)[ we have Qx„ —)■ Qx which is equivalent to 
f(Vz G {1,... ,m}) Ci{xi 

,n? • • • ; ^m,n ) Ci{xi , . . . , Xm) 

1 (VA: G {l,...,s}) D^^Vk,n ^ D^^Vk. 


(4.32) 


Therefore, if the operator (xj)i<j<m ^ {Cj{xi)i<i<rn)i<j<m is demiregular at (xi,...,Xm), we 
obtain (Vi G {1,... , m}) Xi^n —^ Xi- By the same season, if there exists j G {1,..., m} such that 


D- ^ is demiregular at Vj , the Vj^n —^ Vj ■ 


as m 


(iv) This conclusion follows from the definition of the demiregular operators by the same reason 


(hi) □ 


We next provide an application to the following minimization problem considered in [521 Prob¬ 
lem 5.1], where several applications are discussed. 
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Example 4.8 Let m and s be strictly positive integers. For every i G {1,..., m}, let JCi be a real 
Hilbert space, let Zi G JCi, let fi G ro(/Cj). For every A: G {1,..., s}, let be a real Hilbert space, 
let Tfc G Gk, let ik £ ^o{Gk) be a strongly convex function, let gi~ G ro(0fc). For every i G {1,..., m} 
and every A: G {1,... , s}, let Lk^i: JCi ^ Qk be a bounded linear operator. Let ip: JCiX .. .x JCm —>• 1^ 
be a convex differentiable function with a Lipschitz continuous gradient. Suppose that there exists 
X = (xi,... ,Xm) such that, for every i G {1,... , m}, 


Zi G 


s / m \ 

dfi{xi) + ^ Ll i o ^94 □ dgk'j ° ( X] ~+ Viip{x), (4.33) 

k=l ^j=i ^ 


where is the i-th component of the gradient V(/?, and that the set V of solutions to the primal 
problem 


miniinize^ X {fiixi) - {Xi I ) + ^ (4 n s-fc) f X] ^k,iXi - Tk 

k=l ^ i=l 

+ip{xi, . . .,Xm), 


xie/Ci,...,x 

m eK m . ^ 

1 = 1 


is nonempty. Denote by T> the set of solutions to the dual problem 

- X] ^k,iVk , 

k=l 

+X] +9*k{vk)+{vk kfc) y 

k=l ^ ^ 


minimize I □ I f* 
viegi,...,vseg,y 

1 = 1 


l<i<m 


(4.34) 


(4.35) 


The problem is then to find a random vector V x P-valued almost surely. 


Corollary 4.9 For every z G {1,..., m}, let V) G 'B{JCi) be self-adjoint and strongly positive. Let vq 
be a strictly positive number such that for every x = (xj)i<i<m and y = {yi)i<i<m inJCiX...x JCm, 

m m 

^ {xi - Vi I Vi<p{x) - Viip{y)) ||Vi(^(x) - Viip{y)\\v.. (4.36) 

i=l i=l 

For every k G {1,..., s}, let Wk G 'B(^fc) be self-adjoint and strongly positive. Let go be a strictly 
positive number such that for every v = {vk)i<k<s and w = {wk)i<k<s in Gi x ... x Qg, 

S S 

Y, {vk - Wk I V£Uvk) - Viliwk)) > goYW^^K^k) - V4(«^A:)llk- (4-37) 

k=l k=l 

Let ^ G ]0,+oo[ be defined by (|4.25l) . /? = /3| 6e defined according to (|4.15l) . let e G 

let (An)nGN a sequence in [e, 1], let (an)neN a sequence in [0,1 — e]. For every i G {!,... ,m}, 
let (aj^n)nGN ba a JCi-valued, squared integrable random process, and let Xig be a JCi-valued, squared 
integrable random vector and set Xi^-i = Xig. For every A: G {1,..., s}, let (bi^ri)nGN be a Gi-valued, 
squared integrable random process, and let Vig be a Gi-valued, squared integrable random vector and 


0,min{l,,5}L 
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set Vi-I = Vifi. Then, iterate, for every n G N, 


Set 


(i) For i = 1,... ,m 
I Cj,n — Xi,n T (y.n{Xi,n 
(n) For k = 1,..., s 

I ^fc,n '^k,n “1“ Cliji(jJk,n ^k,n—l] 

{in) For i = 1,..., m 

1- ti,n — XyA:=l i^k,n ^i,n 

2- Pi,n •— (ci,n ^i{ti,n ^i)) 

3- yi,n •— ‘^Pi,n Cj,n 

4- Xi^n-^-l .— Xi^n + -^n{Pi,n Xi^n) 

(iv) For k = 1,..., s 

F ^fc,n ~ Xyi=l ^k,iyi,n i>k,n 

2. qk,n ■= PrOX^'“ {dk,n + ^4 (ufc,n - Xk) ) 

3- Vk^n+l ■ Xk^n T ^n{Qk,n Xk^n)- 


(Vn G N) 


Xn •— (3^1,71) • • • ) Xfn,m ^l,n) • • • ) ^^s,n) 
— (^Ijm • • • ) ^m,ni bl,n) • • • ; bs^n,) 

, 3~n — ^ (xq , ■ ■ ■ , Xn ). 


Suppose that the following conditions are satisfied. 


(4.38) 


(4.39) 


(i) (Vn G N) EfanlJ^] = {{Vip{ci^n ■ ■ •, Cm,n))i<i<m, V£f(di,„), .. vends,n))- 

(ii) EnGN E[|| E^l ai,n - Viip{ci,n ■ . . , Cm,n)f + ELl l|bfc,n “ ( 4 ,„) f |g-„] < +00. 

(iii) maxi<i<msup„gi^ ||xi,n - a;i,n-i|| < oo a.s. and maxi<fc<^ sup^gpj < oo a.s., 

and y 4 “Eoo. 

Then the following hold for some random vector (^u • • • ... ,Vs), VxV-valued almost surely. 


(i) (Vi G {1,..., m}) Xi,n Xi and (VA: G {1,..., s}) Vk,n Vk almost surely. 

(ii) Suppose that the function p is uniformly convex at {xi,... ,Xm), then (Vi G {l,...,m}) 
Xi,n —>■ Xi almost surely. 

(iii) Suppose that there exists j G {1,..., m} such that i* is uniformly convex at Vj, then Vj,n Vj 
almost surely. 

(iv) Suppose that (V(xi,... ,Xm) G /Ci x ... x /Cm) p{xi,... ,Xm) = Ei^i hi{xi) where each hi G 
Fo(/Cj) is a convex differentiable function, there exists j G {!,... ,m} such that hj is uniformly 
convex at xj, then Xj,n —)• Xj almost surely. 


Proof. Using the same argument as in the proof of [521 Corollary 5.1], Example 14.81 reduces to 
special case of Problem 14.11 with 


(Vi G {1,..., m}) Ai = dfi and Q = Vpp, 
(f/k G {1,..., s}) Bk = dgk and Dk = 54- 


(4.40) 
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Furthermore, by (12.41) and (|2.5I) . the algorithm (|4.c{8l) is a special case of the algorithm (I4.26|) . 
Therefore, the conclusions follow from Theorem K7\ □ 

Remark 4.10 Here are some remarks. 


(i) The algorithm proposed in this section is new, also if (Vn G N) «„ = 0, since a stochastic 
algorithm for system of monotone inclusions involving both non-smooth coupling and smooth 
coupling is not available in the literature. The stochastic algorithms for either solving smooth 
coupling or non-smooth coupling can be found in m Section 5.2] or [36l Section 4]. In the 
case when (Vn G N) 0 ;^ = 0, we obtain the stochastic extension of the framework in |52l 
Section 4 and 5] and in |13[ Section 4.2]. Furthermore, in the special case when m = s = 1, 
we obtain a stochastic version of the inertial primal-dual algorithm in [38]. See also [8] for 
related results. 


(ii) Sufficient conditions, which ensure that the condition (|4.33l) is satisfied, are provided in [TT] 
Proposition 5.3]. For instance, (14.3311 holds if ()4.34l) has at least one solution and (ri,... ,rs) 
belongs to the strong relative interior of the following set 


m 

E 

2 = 1 




l<A:<s 


(Vf G {1,... ,m}) Xi G dom/j 

(V/c G {1,..., s}) Vk G dom gk -|- dom^^fc 


4.2 A second class of the stochastic inertial primal-dual splitting methods 

In this subsection, we will derive a new class of stochastic inertial primal-dual splitting methods, 
for the case where (Vi G {!,... ,m}) A = 0. This class of algorithms corresponds to the choice 
t/i = T in Lemma 1131 

Theorem 4.11 In Problem \4-l\ set (Vz G {1,... ,m}) A = 0. Let j3 he defined as in ()4.17l) . and 
assume 2/3 > 1. Let e G ]0,min{l,/3}[, and let (A„)neN be a sequence in [e, 1], let (an)nGN be a 
sequence in [0,1 —e]. For every i G m}, let (aj^n)nGN be a ICi-valued, squared integrable 

random process, and let Xifi be a fCi-valued, squared integrable random vector and set Xi-i = Xi^. 
For every k G {!,..., s}, let Wk G 'B{Qk) be self-adjoint and strongly positive, let (bj^ri)ngN be a 
Qi-valued, squared integrable random process, and let Vifl he a Qi-valued, squared integrable random 
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vector and set Vi^-i = Vi^. Then, iterate, for every n G N, 


Set 


(i) For i = 1,... ,m 

I Q,n — Xi,n S' 

{ii) For k = 1,... ,s 

I dk^n — Vk,n “1“ 0'n{'^k,n Vk^n—l} 

(in) For i = 1,... ,m 

1- Si^n — Ci^n Vi{<ii^n 

2- yi,n — Si^n Fi Xjfc=l i^k,n 

(iv) For k = 1,..., s 

1- Qk,n — {dk,n 'S Xji=l ^k,iyi,n i>k,n 

2- ^^fc,n+l ~ '^k,n 'S ^n{Qk,n '^k,n)- 

(w) For i = 1,..., m 


1- Pi,n — Si^n Vi XyA:=l ^k,i^k,n 

2- Xi^fi+l — Xi^fi -|- \n{,Pi,n Xi^n 


(Vn G N) 


{ Xn 


T 

u ri 


•— (^l,n; • • • ; ^l,n; 

— (^l,n; • • • ; ^m,nt bl^n? • 
= o-(xo,...,xn). 



Vk)) 


Suppose that the following conditions are satisfied. 


(4.41) 


(4.42) 


(i) (Vn G N) E[a„| = ((Q(ci ,n ■ ■ ■ 1 Cm,n))l<i<mj T)^ dl,n) • • • > Df^ds^n). 

(ii) EnGN E[|| “ ^(ci,™ . . .,Cm,n)\? + YJk=l \\^k,n “ ^4,n|P|3"n] < +00. 

(iii) maxi<i<msup„gpj ||xi,n - a;i,n-i|| < oo a.s. and maxi<fc <5 sup^gpj < oo a.s., 

and y (cM Q^n ^ “Eoo. 


Then the following hold for some random veetor (xi,..., Xm, vi,..., Vs), VxV-valued almost surely. 


(i) (Vi G {1,..., m}) Xi^n Xi and {'Sk G {1,..., s}) Vk^n almost surely. 

(ii) Suppose that the operator (xi)i<j<m iCj(xi)i<i<m)i<j<m is demiregular at {xi,... ,Xm), 
then (Vi G {1,..., m}) Xi^n —^ Xi almost surely. 

(iii) Suppose that there exists j G {1,... ,m} such that D~^ is demiregular at Vj, then Vj^n Vj 
almost surely. 

(iv) Suppose that there exists j G {1,..., m} and an operator C: /Cj —)• ICj sueh that (V(xi)i<i<m G 
(/Cj)i<j<m) Cj{xi,... ,Xm) = Cxj and C is demiregular at Xj, then Xj^n —^ Xj almost surely. 


Proof. Set 


'xn 

— • • 

• ; ^m,n) 


'vn 

— ('^l,n? • • 

• ; '^s,n) 


X-n 

— (ci,n; • • 

• t Cm,n) 


dn 

II 

(S 

3 

• t dg^n) 


Sn 

— (5l,n? • • 

• t ^m,n) 

and < 

Qn 

II 

• ? Qs,n) 

(4.43) 

Vn 

II 

3 

• ; ym,n) 



3 

II 

• t bs,n) 


.Pn 

= (Pl,n, • • 

• 5 Pm,n) 


^a-n 

— • • 
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Using the notation introduced in (I4.42p and (I4.43p . the definition of the operators V, W, L in (??), 
the definition of B and the reference vectors z,r as in (14.111) . we can rewrite (I4.5ip as 


(Vn G N) 


Cn — Xji + Oin\X,^ Xfi—l) 
d-n — Vji Oln{Vn 

Sn = Cn- V{an - z) 

Vn — VL dfi 

Qn = JwB-^ {dn + W [Ly^ -bn-r)) 
Pn = Sn- VL*q^ 

Xn+1 — Xn ^n{Pn 

'^n+1 — ^n{Qn '^n')- 


(4.44) 


Now, we have 


(VnGN) q^ = J^B-^{dn + W{Ly^-bn-r)) 

<t4 (Vn G N) W~^{dn - qn) + {Ly^ - bn-r) ^ B^^qn 

G4 (Vn G N) W-\dn - qn) + {Lsn - LVL*dn) -bnGr + B ^qn 

G4 (Vn G N) W-\dn - qn) - LVL*{dn - qj + LSn - LVL*qn - bn € r + B ^qn 

G4(VnGN) W-\dn-qn)-LVL*{dn-qn)+Lpn-bner + B~^qn. (4.45) 


Since A = 0, we next have 


(VnGN) Pn = Sn-VL*qn 

(VnGN) V~^{cn-Pn) - L*qn-an^ -Z +Apn- (4.46) 

Now, by setting (Vn G N) yn = (p„,q„),Un = {cn,dn), by using (|4.16l) and the definition of T in 
(14.71) and M, S in ()4.ini) . we obtain 

(VnGN) T"^(un - yn) - a„ G Myn + 5yn, (4.47) 

which is equivalent to 


(Vn G N) yn — <^T(M+S)(Un — Ta„) — JT(M+S)(Un — TUn). 
Therefore, (14.4411 becomes 


(Vn G N) 


Un — Xn T Otni^n ^n—l) 
Yn = >^T(M+S)(Un “ TUn) 

^n+l — ^n T '^n(yn ^n); 


which is a special instance of the iteration (|3.ip with (Vn G N) 7 n = 1 G ]e, (2 — 
that conditions (i) (hi) can be rewritten in the space Ti defined in (|4.5I) as 


(4.48) 


(4.49) 


We next see 


(al) (Vn G N) E[an|Tn] = Qun- 

(bl) EngN - QUniPiTn] < +00 a.S. 

(cl) sup^gpj ||xn - Xn-i|| < oo a.S. and XlneN^^i < +oo- 
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Therefore, all the assumptions in Algorithm 13.11 and Theorem 13.21 are satisfied. 


(i) In view of Theorem Eini*" ^ {x, v) which is equivalent to (Vi G {1,..., m}) Xi^n Xi 
and (V/c G {1,..., s}) Vk,n ^ Vk- 


(ii) k (hi) 


By Theorem 13. ^(ii)[ we have Qxn —)• Qx which is equivalent to 


(Vi G {1, . . . , m}) Ci{xi^n, • • • , Xm,n) ^ Ci{xi 
(VA; G {1,..., s}) ^Vk^n ^Vk- 


(4.50) 


Therefore, if the operator {xi)i<i<m {Cj{xi)i<i<rn)i<j<m is demiregular at {xi,... ,Xm), we 
obtain (Vi G {1,... , m}) Xi^n —^ Xi- By the same reason, if there exists j G {1,..., m} such that 
D~^ is demiregular at vj, the Vj^n vj- 


IV 


This conclusion follows from the definition of the demiregular operators as in 


in, 


Corollary 4.12 In Example O set (Vi G {1,..., m}) fi = 0. For every i G {1,..., m}, let 
Vi G 'B{ICi) be self-adjoint and strongly positive. Let uq be a strictly positive number such that 
(I4.36P is satisfied. For every A; G {1,..., s}, let Wk G “BiOk) be self-adjoint and strongly positive. 
Let fiQ be a strictly positive number such that (I4.37p is satisfied. Let fi be defined as in (I4.17p 
such that 2fi > 1, let e G ]0,min{l,/3}[, and let {Xn)neN be a sequence in [e, 1], let (an)neN be a 
sequence in [0,1 —e]. For every i G let (ai^n)ngN be a ICi-valued, squared integrable 

random process, and let Xi^ he a ICi-valued, squared integrable random vector and set Xi-i = Xi^. 
For every k G {l,...,s}, let Wk G 'B{Gk) be self-adjoint and strongly positive, let (bj_ri,)neN be a 
Qi-valued, squared integrable random process, and let Vifi be a Qi-valued, squared integrable random 
vector and set Vi-i = Vi^. Then, iterate, for every n G N, 


Set 


(i) For i = 1,..., m 

I Ci,n — Xi^n T (^nixi^n Xi^n—l') 

(ii) For k = 1,... , s 

I dk^n — Xk^n T OLn{yk,n Xk^n—l) 

(Hi) For i = 1,..., m 

!• Si^ji — Ci^n zfi) 

2. yi,n — Si,n Vi ^^k=l 

(in) For A; = 1,... , s 

1- qk,n = (4,^ + Wk[ YT =1 Lk^iVi^n 

2* '^k,n ^n{Qk,n '^k,n)‘ 


(v) For i = 1,..., m 

1 - Pi,n = Si^n — Vi Ylk=l ^k,idk,n 
2 . Xi^fi+l — Xi^n T Xn{pi^n Xi^ri, 


(Vn G N) 


Xn — ■ ■ ■ ? ^l,n? • • 

^ • • • ? bl^n, ■ ■ 

^ 3 ~n — ^(xq ; ■ ■ ■ ? X72) • 





i-fc)) 


Suppose that the following conditions are satisfied. 


(4.51) 


(4.52) 
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(i) (Vn G N) E[a„| = {{VMd vei{di,n),...ytsids,n))- 

(ii) EnGN E[|l EZl Hn - . . . , + ELl l|bfc,n “ (4,„) f |g-„] < +00. 

(iii) maxi<j<msup„gi^ ||xi,n - < oo a.s. and maxi<fc<^ sup^gpj < cx) a.s., 

ClTld y Q^rf. “t“00. 

Then the following hold for some random vector (®i,... ■ ■ ■ iVs), VxV-valued almost surely. 

(i) (Vi G {1,..., m}) Xi^n Xi and {\/k G {1,..., s}) Vk^n almost surely. 

(ii) Suppose that the function ip is uniformly convex at {xi,... ,Xm), then (Vi G 
Xi^n —>■ Xi almost surely. 

(iii) Suppose that there exists j G {1,..., m} such that £* is uniformly convex at Vj, then Vj^n Vj 
almost surely. 

(iv) Suppose that (V(xi,... ,Xm) G JCi x ... x /Cm) pixi,... ,Xm) = YlZi hiixi) where each hi G 
ro(/Cj) is a convex differentiable function, there exists j G {1, • • • ,m} such thathj is uniformly 
convex at Xj, then Xj^n Xj almost surely. 

Remark 4.13 Let r G ]0, +oo[ and a G ]0, +oo[. If in Problem 14.11 (Vi G {1, • • • = tM 

and Ci is n cocoercive for some n G ]0,+oo[, and (V/c G {l,...,s}) 114 = cld and is p 
cocoercive for some /r G ]0, +oo[, then the condition 2/3 > 1 in Algorithm 14.121 is satisfied for r and 
a sufficiently small. Indeed, in this case /3 = min{n/r, {pL/a){l — rcj||L|p)}. 

Remark 4.14 The operator T has been first considered in [TB], and then used in USES], in the 
deterministic setting. The results of this subsection constitute an extension of m Section 4.2] to 
the stochastic and inertial setting. See m for the connections to [9] and [39]. 
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